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INTRODUCTION 


If all the flight vehicle dynamic characteristics that 
yield good handling qualities and good pilot-vehicle 
performance were known, flight control engineers could 
synthesize controllers that produce this dynamic response. 


In the case of flight vehicles exibitinq non-convent Iona 1 
dynamics, sufi'icient data and handling qualities are seldom 
available. Based on the fact that the behavior of the pilot 
during a task is Influenced by tne plant he is controlling 
and that the optimal control model structure for the human 
operator’ has been found to be related to opinion rating^ 
a simultaneous optimal control solution has been proposed by 
Schmidt^. Such a method is based on closed -loop design 
philosophy and leads to a controller that has full-state 
feedback structure. 


The present paper introduces two basic innovations with 
the intent of describing a more practical stability 
augmentation svstem design. In the previous work'’ the 
pilot's " state estimator " was neglected in the 
augmentation synthesis. It ‘will be shown that this 
assumption has a strong influence on the stability 
augmentation (SAS) gains. Secondly, the SAS structure will 
be assumed herein to be a linear combination of selected 
system outputs rather than full -stats feedback. 


SYSTEM STRUCTURE AND PILOT MODEL 


The complete pi ant-control 1 er dynamics are represented 
by the block diagram in Fig.1. In state variable form we 
have the following linear t ime-i nvar 1 ant system, 

X = Ax + Bu + Dw 

yp = CpX( t-r) + Vp (1 ) 

% = C3X, 

with xeRn , U6R„, , ypSRp , ys^Rs . weR^ as dimensions of the 
time varying variables and, 

u = Up + Us 




exfcerna.1 disturbance 


FIG 1. BLOCK DIAGRAM OF THE SYSTEM DYNAMICS 


2 





Us = 


In the above, note that u Is the total control vector 
which Includes the contributions of botn pilot input Up and 
augmentation Input u^ ; Vp(t) Is the pilot's observation 
noise and Is character I st ic of the pilot's Imperfect 
perception, assumed to be described by a v/hite noise process 
with statistics: N(0, Vp)* . Also w Is the system driving 
noise that models the effect of external disturbances (or 
commands in the case of a tracking task) and It Is also 
described as a white noise process with statistics: N(0, W) . 

The following assumptions are mads: 

i) The system described by (1) is completely controllable 
(stab i 1 i zabl e) and observable (detectable).® 


ii) The output vector to the SAS, y^y is noise free. This 
implies that errors in the measurements are negligible 
with respect to the pilot's observation noise. 

At this point, the character I st i cs of the chosen pilot 
model will be briefly reviewed. 

The optimal control model is based on the hypothesis 
that a v.'sl 1 -trained, well motivated pilot chooses his 
control policy Up , subject to human limitations and 
understanding of the task he is performing, to minimize a 
quadratic index of performance given by: 

Jp = E{ Lim 1 /t/(x'tQx + u'^pRUp + u'pQUp)dt} (2) 

T-*oo o 

where E{ • } denotes the expected value and (•)" denotes 
vector transpose. 

The weighting matrices Q>0, R^O, G>0 quantify the 
pilot's strategy and workl oad/performance trade off. Also, 
the control f'ate weight G in (2) can be related to 
neuromuscul ar lag in tne pilot. 

Defining the augmented state vector: 


X = 



(3) 


* N(a, b) denotes normal probability density with mean a and 
var i ance b 
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( 1 ) becomes : 


• 

As b' 


t * 

0 

• 

D 

X = 

0 0 

X + 

I^ 

Up + 

0 


Yp = [Cp Ojx(t-r) + Vp 

with: As = A + BECg (plant plus any augmentation) 
Jp = E{ Llm l/T/lx'^QiX + uTpGUp)dt} 

Q 


( 4 ) 


and, 

( 5 ) 


Qi 


Q o' 
0 R 


>0 


In the optimal control model, the pilot estimates all 
the states of tne system from his vector of observat i ons yp . 
This activity is modeled as a Kalman-Bucy filter along with 
a least mean-square predictor to compensate ror his time 
delay. 


It can be shown that under this structure the optimal 
contro 1 1 er Is 


Up = KX + v„, = + K^,Up + v^ (6) 

where v,„ 1 s a white noise process which represents motor 
noise contaminating the pilot s commanded control. It (v^) 
is assumed to have zero mean and intensity V„,- The gain 
matrix is: 

K = -g"'[0 i]p (7) 

where P Is the solution of the algebraic Riccati equation: 


’a'^p 0 


’As b' 


' o' 

— if 


P + P 


+ Qi - p 


G |o I Ip (8) 

. B'T 0 


o 

o 

, I 



The estimate X of the state vector x Is derlvec from a 
least mean-square predictor in series with the Kalman Filter 
estimating the delayed state x(t-r). Now, in oiir work, we 
will consider only the Kalman .'=’11 ter dynamics and increase 
the noise variances slightly to account for delay and 
prediction. So we have then: 


4 



(9) 


( 10 ) 


( 11 ) 


DETERMINATION OF THE OPTIN>IA.i_ CONTROLLER 


In the original app--'oach'^ , the pilot’s estimation 
process was assumed to have little influence on the 
augmentation system, heur i st ical 1 y invoking a "separation 
principle". This v/as done by defining: 

X = X + € 

and the error e was treated as an additional white 
disturbance to the system (and thereby treated as 
uncorrelated with x). 

In the present paper we will show instead that the 
presence of additional dynamics due to Che state estimator 
affects substantially the augmentation gains and can not be 
neglected in a design synthesis procedure. Further, we will 
derive the expressions for the optimal SAS gains considering 
the control to be of the form: 

U3 = Ey^ (12) 
or a linear combination of measurable outputs. 

The dynamics of the plant with the augmentation and 
pilot input is given by: 


A 

X = 


’a= b' 

A 

0 ' 

t 

’ Ml' 

( 1 


X + 


Up + 


(yp- Cp 0 

0 0 

4 


I 


Ma 

» t 

i j 


X) 


The Kalman Filter gain matrix M is given by: 


M = 


M, 

M2 


= Z'T 




with Z solution of: 


’A 3 b' 


’a^ o' 


z + z 


0 

0 


0 


and: 


W = 


D 0 
0 I 


W 0 
0 


W - Z 


0 

0 I 


v;'[c„ o|z=o 
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= (Cs o]x (13) 

plus the state estimator dynamics Inherenc In tne pilot 
model : 


X 


A, B 


X + 



where as defined previously: 



(13’) 


A 3 = A + BEC 3 


We can now state the optimal control problem for the 
SAS; we wish to find the optimal control ler Ug = Eyg which 
minimizes the index of performance: 

Jg = Jp + E { LIm 1/T /u^gFUg } (14) 

T “^03 o 

with F>0 and Jp as in (5) subject to constraints (13) 
and(13‘), expressable as: 




B{ 0 
0 | K:, 

OL\g-Ml C 
olKjc-MaC 


p 

p 




D 0 0 
0 I 0 


0 0 ivi 

0 I M 



(15) 


Yg = [Cg olo 0)q 
Also noting that: 

Jg = E { Lim 1/T.j'"^(q‘^Qq + u^gFUg)dt} (15‘) 

T a 

with: 

'q 0|0 0 

Q = 0 RiO _ 0 

0 o'k'^xGK- kjJqk 

0 OiK^^GKp K'rpGK 

Rewriting (15) and (15*) in a more compact form we have: 
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■•’a , 
Ug + Du) 


( 16 ) 


• 

'Ai, 

Ai 2 


'Ba' 

II 

Aa 1 

A2 2 

q + 

0 

Ys = 

JCa 

cr 

0 




qe R2n 


and: 


Js = E { LIm 1/r/qTQq + u'TgFUg)dt} (17) 

T — o 

The newly introduced matrices have obvious structure 
from (15) and ( 1 5 ' ) . 


Eqs . (16) and (17) with the constraint Ug = Ey^ define 
the subopt imal output feedback problem®-'^. The necessary 
conditions for optimality, based on first variation 
principles give the solution as 

)”' (18) 



c^' 

t \ 


E = -F [B^a OJHL 

0 

([C 2 oJl 

0 


v/ith H and L positive definite, unique solutions 
respectively of 


A'^cH + HAc + Q + 


0 0 


0 


( 19 ) 


AgL + LA^g + DWD^ = 0 


wl th: 


Ac 


Ai 1 +B 2 EC 2 A^ 2 
Aj 1 A2 2 


(20) 


( 21 ) 


W = diag. [ W ,V^ ,Vp] 

The matrix L is the covariance matrix for tne system and is 
given by 



Li , = E{XX"}, L 22 = E{XX'^}. L,2 = E{XX’’} 
= L 21 = L 22 


rewriting (18) in partitioned form 
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E = -f‘‘[ , 


B^2Hi aj 


'l,, 

.Li 2 


C -^2 

0 


(CaL, iC^a)' 


E = -F’B^aH, ,Li ,CT2(C2L, iC^af'-F'BTaH, aL, aC^aCCaL, , 0 ^ 2 )“' 
or; 

E = E, + Ea (22) 

As we can see from (22), two terms contribute to the 
total SAS gain matrix, one is due to the plant dynamics, 
while the second is due to the estimator and plant dynamics. 
This shows tnat we can not necessarilv' neglect the presence 
of the estimator when we proceed to the synthesis of a 
stability augmentation system vvi th the pilot included in the 
control loop. 

SPECIAL NOTES 


rrom the general result of 
particular notes; 

(22) 

we 

can 

make two 

1) First of a1 1 if we assume that 
feedback structure or: 

SAS 

has 

a 

ful 1 -state 


Ca = I 

the gain matrix E becomes 

E = -F“'bT 2H, , -F's^aHi 2 L, 2 L 1 1 (23) 

The first term on the RHS of (23) is now the familiar result 
for the linear regulator problem and the second term 
represents the contribution, to the total gain ,of the 
estimator in the pilot model. 

2) If now \ve neglect the estimator as in Ref. 4, the second 
term on the RHS of (23) disappears and we are left with 
gains identical to those in the Reference. 


NUMERICAL EXAMPLE 


To demonstrate the methodology 
previous sections we will use the 
second order plant in a tracking task 
dynamics are: 


described in the 
example of Ref. 4. A 
is considered. Its 
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a(s) 

6 (s) 


1 1 .7 


The ccmmanded signal 6 c (t) is obtained from a white noise 
process o>(t) driving the linear system: 

6 (s) 3.67 

o)(s) s^ + 3s + 2.25 

(o(t) , N(0,1). 

In state variable form, defining x = [ 6 ^ , 6 ^ , 6 , aj’’’ 

fo 10 0 ] fO f 0 

X = -2.25 -3 0 0 X + 0 6 + 3.67 

0 0 0 1 0 0 

0 0 0 0 11.7 0 

• J % J ^ 

where 5 = 5p + 5 ^, the sum of pilot's and augmentation 
controls . 

The indices of performance that 5p -and 5 ^ sre to 
minimize, are respectively: 

Jp = E { Lim l/T/Ua-a^ )2 + 0.016% + g5%]dt} 

T-»oo O 

and : 

J 3 = Jp + E { Lim 1/T/f6%dt} 

T — ►«» O 

The parameter g is adjusted in such a way that a 
neuromuscul ar time constant Tn = .1 secs. is obtained. The 
weighting f on the augmentation control is a fr'ee parameter 
which is varied to yield a family of control 1 ers . 

The pilot is assumed to be able to perceive both 
position error and error rate, that is: 

'ac-al [ 10-10 

Yp = . . = X + Vp 

6 c-a 010-1 

, i ^ 

Three different combinations for output vectors yg are 
analyzed. In all the following results, the simplified 
pilot model (with out predictor but including the Kalman 
Filter) v/as used in the solution, unless noted. However, 
the complete pilot model as presented in Ref. 1 v/as used 
for performance evaluations and comparisons. 



9 



The first table (Table 1) gives the system performance 
in the absence of augmentation. Based on Refs. 2 and 3, 
the term PR indicates the pilot rating on a Cooper-Harper 
scale predicted with the index of performance Jp . Tables 2 
and 3 furnish the performance of the augmented system 
dynamics and the values of SAS gains (in deg/dsg and sec. 
respectively) in the case where only B and B are fedback. 
The results are given as a function of the scalar f, 
weighting the augmentation energy introduced into the 
system. 


Table 1. Unaugmented System Performance 


(0-a) RMS* 

5pRMS* 

Jp 

PR 

1.170 

1 .00 

1 .86 

7.7 


Table 2. Augmented System Performance. = [s, a] 



f 

(e^-e)RMS* 5pRMS* 

Jp 

PR 


100 

1.140 

1 .054 

1 .743 

7.4 

10 

0.786 

0.657 

0.768 

5.4 

1 

0.628 

0.489 

0.463 

4.1 

0.1 

0.618 

0.607 

0.449 

4.0 

0.01 

0.608 

0.795 

0.438 

3.9 



Tables 4 and 5 show a comparison of results between the 
cases in which the state estimator dynamics are included in 
the SAS design (KF) ve'-sus neglected (Ni<F) . The results are 
for a weighting on augmentation energy f = 1. and three 
different possible sets of feedback variables for the SAS 
are considered. Note the significant difference in gains 
and performance betv/een cases. 


★All angles in degrees 
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Table 3. SAS Gains. yg = [d , d] 


f 



100 

-0.0064 

-0.0029 

10 

-0.0625 

-0.0271 

1 

-0.2242 

-0.0818 

0.1 

-0.5823 

-0 . 1 074 

0.01 

-0.7877 

-0.1428 


Now consider Figure 2 that shows .the trend of the 
augmented plant eigenvalues {y^ = [0, 0]) as a function of 
the parameter f (continuous line), and a comparison with the 
eigenvalue pattern from Ref. 4 (dashed line). Also for a 
value f=1 , the effect of the presence of the state estimator 
in the system dynamics (solid vs. open symools) is shown 
for the same cases in Tables 4 and 5. 

The pilot's index of performance Jp and rating PR is 
represented in Figure 3 v/ith yg = [ 0, 0 J ; furthermore , for f 
=1 , a comparison between augmentation feedoacx with and 
without estimator dynamics is carried out as bef^ore. 

Finally, the tracking performance (ffg ) and workload 
(ffs,) are shown in Figures 4 and 5 for these same cases. 


Table 4. Augmented System Performance 


(Qc- 

0)RMS 


RMS 


Jp 

PR 

y = 

KF 

NKF 

KF 

MKF 

KF 

NKF 

KF 

NKF 


0.757 

0.856 

0 . 655 

0.791 

0.708 

(A) 

0.930 

fs) 

5.2 

(^) 

5.9 

0 

0.628 

0.686 

0.489 

0.569 

0.463 

(•; 

0.568 
Co 5 

4. 1 
(•) 

4.6 

(o> 

0,0 

0.303 

0.376 

0.300 

0.350 

0 . 1 00 

0.160 
C V ) 

<1 . 

1 .6 
C ) 

0p0p0 0 


n 




Re(x), d(/sec) 

NOMENCLATURE 

• Eigenvalue behavior with f y = [e, 0] 

■ Eigenvalue behavior f = 1. y = [0 , 0 , 0, 0] 

^ Eigenvalue behavior f = 1. y^ = 0 

o □ A Same as above but estimator dynamics is neglected 
in augmentation design. 


FIG. 2. AUGMENTED EIGENVALUE LOCUS 
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(Oas/pBJ)m ‘(X)IUI 




PR 



A 



RMS Augnentation Activity, 5g(deg.) 

I 

(symbols defined in parenthesis in Table 4) 


FIG. 3 PILOT RATING AND COST vs. SAS ACTIVITY 
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0 


.3 


.7 


• I 


• 5 


RMS Augmentation Activity a, (deg.) 

0 

NOMENCLATURE 

Continuous line behavior with f. = [0, 0] 

T behavior for f = 1. y. = [0_- 0_, 0 0] 

A behavior for f = 1. y^ = 0 

Same as above but estimator dynamics is neglected in SAS design. 


FIG. 4. TRACKING ERROR vs. SAS ACTIVITY 
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0 


.1 


.3 


.5 


.7 


RMS Augmentation Activity o. (deg.) 
NOMENCLATURE 

t 

Continuous line behavior with f, = [e, 0] 

• • 

▼ behavior for f = 1. y. = [e., e^, 9 , 0 ] 

A behavior for f = 1. y =0 

s 

V A Same as above but estimator dynamics is neglected 
in SAS design. 


FIG. 5, STICK RATE vs. SAS ACTIVITY 
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Table 5. Augmentation Gains 






m 

n 

^0 c 

E<5 

E^ 

KF NKF 

KF NKF 

KF NKF 

KF NKF 


-0.264-0.109 

-0.224-0.107 

0.573 0.487 0.150 O.OSO -0.639 -0.535 


-0.082 -0.048 
-0.255 -0.130 


EXPERIMENTAL CORRELATION 


The methodology is now applied to "predict" the optimal 
pitch rate feedback gain for a T-33 aircraft in a pitch 
tracking task. The results will be compared to experimental 
data available from fixed-base simulations. 

The short period dynamics of the aircraft (all angles 
in degrees) are given by: 

j a = q 

I q + MqP -i- M^,a + Ms5 

1 a = q + Z„a + Z^5 

The commanded pitch angle is given by the relation: 
d ^ = —0 ,10c + w 

w(t), N(0, a-) (T^ chosen to give = 10 deg^. 

For level flight at Mach 0.5 and altitude 4,545 m. (15,000 
ft.), we obtain the following system dynamics in state 
variable form: 


-0.1 0 0 0 


• 4 

0 


w 

0 0 1 0 

X + 

0 

5 -I- 

0 

0 0-1 .0524 -3.01 


-14.52 


0 

000 -1 .384 

4 


-0.08 


0 


The state vector is x = the total 

elevator control is the sum(5p -r 5^) of pilot’s and 
augmentation inputs. The indices of performance to be 
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minimized by 5p and 5 ^ are: 

Jp = E{ Lim 1/T/T(0p-0)2 + 0.00252j,]dt} 

T-» oa o 

Jg = Jp + E{ Lim i/Tj’ 0 . 01 ( 72 ^dt} 

T cm O 

According to Ref. 8, we as*sume that the pilot is able to 
perceive position error informat ion (0^-0) and that the 
augmentation measurement is pitch rate 0 only, thus: 

Yp = (0C-0) + Vp 

y^ = [ 0 0 1 . o]x 
5s = -K^ q 

The next table contains the augmentation gains predicted 
with and without inclusion of the pilot's state 
est imat ion , or dynamic compensation. (KF and NKF 
respect i vel y ) 


Table 6. Predicted Rate Feedback Gain (K ^ , sec.) 


KF NKF 


-0.24 0.09 


As it can be seen from Figure 6, the predicted gain and 
the gain ootained experimentally are in vef-y good agreement 
in obtaining the minimum pilot rating. In additicn, from 
Table 6 the importance of the effect of the state estimator 
is underscored. The optimal gain obtained ignoring the 
estimator actually decreased pitch damping!. 

Finally in comparing Figures 6 and 7 we see the 
strong correlation between pilot ratings obtained 
experimentally and the sum of the mean-square error and 
stick rate- or objective function- from simulation. 


SUMMARY- AND CONCLUSIONS 


In the paper v/e have presented a methcoology for the 
design of stability augmentation systems with the human 
operator in the loop, using optimal control theory. 
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The case In which the augmentation has limited-state 
.feedback structure is analyzed and a closed form solution is 
obtained. The need to consider the estimator in the pilot 
model is quantified, in contrast to the hypothesis of Ref 4. 
An example is given to demonstrate these results. In the 
case of a second-order plant we obtained a significant 
improvement in performance and large differences in 
augmentation gains due to the inclusion of a dynamic 
estimator in the pilot model. It is also shown that, as a 
function of augmentation activi ty(agg) , limited state 
feedback provides much improved performance. 

Most significantly, the analytical determination of the 
optimum rate feedback gain was verified experimentally, for 
pitch tracking, via fixed-base simulation. 
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Gain, K: (sec) 

w 


FIG 6. PILOT RATING vs. GAIN 
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